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(54). Abstract Title 

A digital Interactive system for providing full interactivity with live programming events 

(57) An interactive digital system (1)is provided for enabling TV viewers active participation in a live 
broadcast event, such as a sporting event (10). Cameras (100) at the sporting event (10) provide several video 
steams which are integrated with recorded video streams in a control studio (5). Interrogatories or instructions 
to be presented as graphics are also prepared and integrated into the programming, as are audio streams 
output from an audio switch (115). A digital compression device (125, 130) digitally compresses the video and 
audio signals, and a digital multiplexer (140) multiplexes the compressed video and audio signals into a 
combined digital program stream. This combined program stream is transmitted to a subscriber viewer at a 
receiver site (155). A digital cable box (25), connected to a TV monitor (195), is arranged to receive, 
decompress and decode the program stream and to enable the viewer to select the video, audio and graphic 
signals by way of any input device (20). 
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A DIGITAL INTERACTIVE SYSTEM FOR PROVIDING FULL INTERACTIVITY 
WITH LIVE PROGRAMMING EVENTS 

5 

The present invention relates to a system for providing live interactive 
programming, and to a method for providing live interactive digital programming. 

Interactive video and audio presentation systems are currently being 
10 introduced into the entertainment and educational industries. For example, U.S. 
patents nos. 4,264,925 and 4,264,924 disclose systems providing both audio 
and video interactivity, and disclose interactive television systems where 
switching among multiple broadcast or cable channels based on viewer 
selections provides an interactive capability. 

15 

These systems have been enhanced to include memory functions using 
computer logic and memory, where selection of system responses played to the 
viewer are based on the processing and storage of subscriber responses as 
disclosed in U.S. patent no. 4,507,680. 

20 

The benefits of providing interactivity through the use of different audio 
responses is disclosed in U.S. patents nos. 4,847,698, 4,847,699 and . 
4,847,700. These television systems provide a common video signal 
accompanied by several synchronized audio channels to provide content related 
25 user selectable responses. The audio signals produce different audio 

responses, and in some cases, these are syllable synched to a first audio script 
and to the video signal (such as to a person or character on a display), providing 
- the perception that the person's or character's mouth movements match the 
spoken words. 

30 

Interactivity is brought to the classroom in U.S. patent no. 5,537,141 . The 
distance learning system described in this patent enhances.the classroom 
educational experience through an innovative use of interactive technology over 
transmission independent media. When an instructor, either broadcast live on 
35 video or displayed from videotape, asks a question, each and every student 
responds, preferably by entering a response on a remote handset, and each 
student immediately receives a distinct and substantive audio response to his or 
her unique selection. 
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Individualization of audio is brought to the home as disclosed in U.S. 
patent no. 5,585,858. This system provides a program that can be watched on 

5 any conventional television set or multimedia computer as a normal program. 
But if the viewer has a special interactive program box connected to the 
television, he or she can experience a fully functional interactive program. Each 
interactive viewer enjoys personalized audio responses and video graphics 
overlayed on the screen. The interactive program can be provided to television 

10 sets or to computers by cable, direct broadcasts satellite, television broadcast or 
other transmission means, and can be analog or digital. 

The present invention seeks to provide an interactive presentation system 
for providing true video, audio and graphics interactivity with digital programs 
15 broadcast live. 



According to the present invention there is provided a system for 
providing live interactive programming, comprising: means receiving video 
signals; means for producing corresponding audio signals; at least one digital 
20 compression device for digitally compressing the video and audio signals; a 
digital multiplexer for multiplexing the digitally compressed video and audio 
signals into a combined digital program stream; and transmission means for 
transmitting the combined digital program stream. 

25 The invention also extends to a method for providing live interactive digital 

programming, comprising the steps of: obtaining a plurality of video signals; 
producing one or more corresponding audio signals; digitally compressing the 
video and audio signals; digitally multiplexing the digitally compressed video and 
audio signals into a combined digital program stream; and transmitting the 

30 combined digital program stream. 

An embodiment of an interactive digital presentation system of the 
invention allows the viewer active participation in selecting digital video steams, 
associated with different camera angles, for example, and integrated audio 
35 and/or graphics segments. Further, Web pages from Internet Web sites can be 
integrated into the program. The system is particularly suited for the 
environment of live events, such as the broadcast of live sporting events. The 
viewer can appear to direct the camera shots by.instantly changing among 
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various camera angles, choose player interviews, or display associated 
statistical data on the team or players via graphics. In this manner, the system 

5 allows the individual subscriber to act as if he or she has control over how the 
program is directed and presented on their personal television set. In addition to 
selecting different camera angles, various audio options, closeups, slow motion, 
replays, graphics overlays, graphics or audio from Web sites, etc., are all 
possible. Further, games can be integrated with the live sports programming to 

10 increase viewer interest. 

Thus, viewers can customize the content of programs. An interactive 
digital presentation system of an embodiment of the present invention is 
particularly advantageous for viewing live sporting events. Viewers are not 

15 limited to selecting from multiple camera angles, but may also call up player 
statistics on demand, listen to selected player interviews, etc. Cameras can be 
focused on different segments of an event. Further, video options could include 
video replay, slow motion effects, isolation on a particular player or group, etc. 
Changes are seamless, thereby adding to the effect that the viewer is directing 

20 the television show just as a director now does from a control room. 

This "director" role by the viewer is possible due to the interactive 
technology of the present invention and also due to the digital compression and 
transmission scheme which allows for much greater information throughput over 
25 a given bandwidth, allowing viewers to choose from angles that are already 
available but presently cut by the director. 

At the source, a plurality of video cameras may be provided, each of the 
video cameras relaying a different predetermined view of an event. Video 

30 signals corresponding to the different cameras are forwarded to a central control 
studio. Further, one or more audio signals or graphic statistical overlays can be 
collected and sent to a central control studio. After receiving the video, audio, 
and graphics signals at the central control studio, these signals are digitized and 
compressed in digital video and audio compressors. These signals are then 

35 combined with special data cpdes into a "digital package," and subsequently, 
transmitted over a cable distribution system. The special data codes are the 
keys to unlocking the interactive potential of the program. 
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The digital program signals are transmitted to a receive site by any 
suitable transmission means. Once received by a receive antenna, the digital 

5 program signals are passed along on a digital cable television distribution 

system to the viewer homes. Other signals or commercials may be inserted at 
the local head end. The signals are received and processed in a digital cable 
box. Selections of the video, audio, graphics display and/or Web pages can be 
made as a function of immediate viewer entrtes, or to interrogatory responses 

10 presented at the beginning or during the program, or based on a prestored 
viewer profile. Once a decision is made to switch from one video option to 
another video option, the digital switch is performed seamlessly. 

At predetermined times or immediately upon user entry, the program may 
15 retrieve and branch to informative segments from Web sites. For example, a 
viewer watching a sporting event, through a system of the invention, may 
receive a stream of Web pages which provide additional, specific information 
relating to a favorite player, team or perhaps the remaining schedule for the 
sports team, as examples. In addition, users can take advantage of the two-way 
20 capabilities of the Internet to respond to polls or to link to additional sites. 

Another Internet-based application allows advertisers to speak more 
directly to consumers by directly sending Web pages to the consumer instead of 
merely displaying Web addresses in their commercials. The particular 

25 advertising information from Web sites can be targeted to viewers based on the 
viewer profile, stored either in the digital set top box or at the cable headend. 
Alternatively, Web site access can be initiated by the viewer by simply clicking 
on the remote during the commercial. Thus, viewers have the capability to 
individually select Web sites if they want more information from advertisers, for 

30 example. 

The video programming and corresponding Internet pages can be viewed 
either on personal computers equipped with a television card on special digital 
cable boxes with stored interactive Internet application software providing 
35 Internet access, or on digital television sets, all of which would utilize the 
specialized TV/Internet software of the present invention. 



5 



Systems and methods of the invention also have applications for other 
types of programming. For example, viewers can direct the scenes of a murder 
5 mystery. Switching from one scene to another can be done seamlessly without 
noticeable effect on the viewer. Further, systems and methods of the invention 
may be used for any kind of live or pre-recorded event. For instance, a music 
concert or a political convention may be enhanced as described herein. 

10 Embodiments of the present invention will hereinafter be described, by 

way of example, with reference to the accompanying drawings, in which:- 

Figure 1 is a diagram of a network and equipment for providing live digital 
programming, 

is Figure 2 is a block diagram of an interactive digital cable box allowing 

seamless switching between video signals, 

Figure 3 is a block diagram of an alternative dual-tuner interactive digital 
cable box allowing seamless switching between video signals, 

Figure 4 is a block diagram of another alternative interactive digital cable 
20 box allowing seamless switching between video signals, 

Figure 5 is a time diagram showing a representation of trigger points and 
corresponding video, audio and/or graphics segments, one or a combination of 
which are selected for presentation to the subscriber immediately after the 
execution of the trigger point function, 
25 Figure 6 is a block diagram of an alternative embodiment of an interactive 

system including Internet access, and 

Figure 7 is a block diagram showing a two-way configuration of an 
interactive system of an embodiment of the invention. 

30 Figure 1 illustrates an embodiment of an interactive digital system 1 for 

producing a powerful personalized program allowing the home viewer an 
expanded set of programming options. Digital TV streams are put into digital 
packages made up of video, audio, data codes and graphics, and are used to 
provide personalized responses to viewer selections. Such responses can be 

35 further enhanced by allowing access to Internet Web sites 1 70. In this manner, 
sports such as golf, football, baseball, basketball, etc. can now be watched with 
greater interest and involvement 
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As shown in Figure 1 , several possible video streams are gathered by 
way of cameras 100, strategically located at a live event, such as a sporting 

5 event 10, for example. Currently many cameras 100 are employed at a sporting 
event 10. Super Bowl coverage, for example, typically encompasses 25 to 30 
cameras. These live video streams can be integrated with recorded video 
streams which, for example, could include highlights from the current game or 
past games, player profiles, etc. To describe the components and operation of 

10 the present invention, the production and transmission of a live sporting event 
10, such as football, is described hereinbelow, by way of example. However, it 
will be appreciated that the invention is not limited to providing interactivity with 
live sporting events and that other applications are possible. 



* I 

I » 

8 

particular viewer. The preparation of the graphics for presenting such 
interrogatories occurs off-line at the control studio 5 using chyron or any graphics 
language. These interrogatories or instructions will ultimately be displayed to the 
home viewer, preferably in the form of graphics, to facilitate the interactive 
5 responses. The producer creates these graphic video slides of questions on a 
computer using the text editor and chyron. Associated with each question, the 
producer enters a number of possible viewer options. Then, the producer relates 
each possible user entry to one or more corresponding interactive responses. If 
the response is information from an Internet Web page, the producer will 
10 indicate the particular Uniform Resource Locator (URL) of the Web page. The 
producer sets a time stamp for when each particular question will appear during 
the program. As explained below in more detail, the viewer response to a query 
will be used to direct which video (and/or audio, graphics, or Web page) option 
will be provided to the viewer. In the present invention, the interactive response 
15 to the query can occur immediately following the entry of the viewer entry or at 
some predetermined later time .in the program using "trigger points/ 7 500 as 
explained in detail below. 

With respect to the video segments, cameras 100 are preferably trained on 
different segments of the sporting event 10. As is common with broadcasts of a 
20 football game, for example, cameras 100 could be located in the endzone, press 
box, the field and at various other locations throughout the stadium. Further, 
various video options can be created including video replay, slow motion, 
isolation on cheerleaders, particular player or group of players. Instant replays are 
created by delaying the live feed for a certain number of seconds. These video 
25 streams are sent to a control studio 5. The control studio 5 contains the necessary 



equipment for packaging the program for delivery to the viewers. The studio 5 
contains a video switcher 105 which receives the live signals from the cameras 
100 by way of various input lines. Further, lines carrying recorded video streams 
from one or more VCRs 110 , computers or CD players feed into the video 
5 switcher 105. The video switcher 105 also receives video inputs from the control 
computer 135. Further, various graphics screens, depicting, for example, sports 
team or player statistics can be designed with the control personal computer 135 
and forwarded to the digital video switch 105. The producer, via the control PC 
135, directs which video options to pass through the video switcher 105. At the 
10 output of the video switcher 105, each of the different output video streams access 
, a separate encoder 125 and are all GENLOCKED, so that each video stream is 
synchronized with the other video streams; 

After encoding, the video streams are input into a video compressor 125. 
Preferably, the digital compression scheme is MPEG-2. Preferably, 64 Quadrature 
15 Amplitude Modulation (QAM) is used as the modulation scheme. In this digital 
embodiment four channels of digitally-compressed video content would carry 
about 27 Mbps using 6 MHz of bandwidth. Alternatively, if 256 QAM is 
employed, seven-to-one video compression can be- achieved with the MPEG-2 
scheme. While MPEG-2 is the preferred compression scheme, the signals can be 
20 compressed according to any known standard including MPEG-1, JPEG, or other 
DCT coding scheme, wavelets, fractals or other transform or waveform based 
technique. 

The control studio 5 also contains an audio switcher 115 which receives 
live audio signals from microphones or recorded audio from tape players 120, 
25 CDs, VCRs 110, etc.. The control computer 135 sends commands to the audio 
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switcher 115 directing which audio options should pass through the switch 115. 
Further, in the audio switcher 115 the various audio signals can be aligned to 
match the various video signals in time. In addition, VCR audio output is 
received by the audio switcher 115. The present invention can accommodate any 

5 number of audio signals as output from the audio switcher 115, as directed by the 
producer. The audio outputs are received by an digital audio 
encoder/compressor 130. The audio signals are then preferably sampled, encoded 
and compressed in the digital audio encoder/compressor 130. The encoding 
technique can be a waveform coding technique such as PCM, ADPCM or DM. 

10 Alternatively, the signals can be encoded using synthesizer or vocoder techniques 
such as MUSICAM, Linear Predictive Coding (LPC), Adaptive Predictive Coding 
(APC), and Sub-band coding. Generally, the transmission rate is about 256 kbps 
per audio for the stereo pair. 

The timing and control for integrating the various multimedia elements is 

15 provided by the ACTV authoring language, a unique set of interactive data codes 
to facilitate the interactive process. The data codes are stored in memory in the 
control computer 135 as part of the ACTV programming language. The codes 
comprise commands, or branch codes, for branching between interactive options, 
timing signals for controlling the interactive program, data or text, commands for 

20 termination and initiation or interactive program viewing, or triggers for 
executing macros. Preferably, these commands are output from the control 
computer 135 and multiplexed with the video streams in the MPEG-2 compressor 
125, as shown in Figure 1. Interactive options that can be branched to based on 
the branch codes include video segments, audio segments, graphics segments 

25 and /or identified Web pages. 
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There are several commands in the ACTV authoring language that 
function to provide the interactive sports programming applications. These 
commands are explained below in Section D, which details programming 
applications. 

5 

B. Tb«» Transmission System 

As shown in figure 1, the digital interactive system 1 uses an interactive 
program delivery system with any transmission means including satellite 15, 
cable 150, wire or television broadcast 175 to deliver the interactive program 
10 (hereinafter "composite interactive program") from the control studio 5 for 
distribution to subscribers in their homes: At the control studio 5, the signals 
from the digital multiplexer 140 are converted to RF and distributed to a 
microwave 175, cable 150 or satellite 15 network. Preferably, the digital interactive 
signal is forwarded from the control studio 5 to a cable headend 150, and 
15 subsequently, sent to the homes via the cable network. 

The program is preferably the broadcast of a live event. For example, live 
• sporting events with added interactive elements can be broadcast from the 
control studio 5. Such live interactive elements could be different camera angles 
100, slow motion video, etc., as discussed above, while also incorporating 
20 prerecorded interactive segments such as highlights. Alternatively, the program 
can be produced off-line and stored in a program storage means at the control 
studio 5. 

In a satellite broadcast transmission, the digital interactive signals are 
transmitted to uplink equipment where they may be multiplexed, upconverted, 



^ modulated, amplified and transmitted by satellite 15 to the receiver site 155 for 
distribution to the homes. 

At the reception end, the composite digital interactive signals enter a 
receiver 155 where the signals are demultiplexed, downconverted, demodulated 
. 5 and then passed to a cable distribution system that directs the signals to the 

homes. Although a cable distribution system 150 is the preferred transmission 
media to the homes, the digital signals may also be distributed by any 
conventionally known technique including satellite 15 to digital satellite 
receivers 155 at the home, flberoptics, low or high power broadcast television 175, 
10 telephone lines, cellular networks, and similar technology can be used 
interchangeably with this program delivery system. 

C The Interactive Digital Br>v 

The interactive digital box 25 is shown schematically in Figure 2. 

15 Preferably, the interactive digital box is a specially adapted digital cable box 25. 
The controller 260 determines what video, audio, graphics and/or Web pages to 
; display based upon the interactive commands which it receives. Based upon the 
commands, it plays the appropriate video, audio, graphics or Web page options. 
The graphics can either be created and sent from the control studio 5 or the 

20 graphical images can be created at the interactive digital box 25 based on 

instructions preferably in the interactive commands, the interactive digital box 
25 connects to a television 165 or other display monitor. Further, the interactive 
digital box 25 can be connected to a digital television 195, in which case an RF 
modulator 245 is not necessary. Each downstream transmission reaches the 

25 subscriber's house, shown in Figure 2, preferably through a tap and drop cable. 
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The user interacts with the program through the input device 20. 
Preferably, the input device 20 is a typical television remote. The user interface 
270 may be an infrared, wireless, or wired receiver that receives information from 
the input device 20. 

5 Regardless of the type of input device 20, user inputs can be utilized by the 

present invention immediately, or at a later time, to result in personalized 
graphics, video and/or audio presentation. For example, the present invention 
utilizes "trigger points," 500 as described below, to enable subsequent branches 
among multimedia segments during the show. 
10 Certain commands are sent from the control studio 5 as part of the digital 

♦ interactive programming to facilitate the collection of user entries. These 

commands are extracted at the digital demultiplexer 210 and sent to the controller 
260 which performs the appropriate action based on the commands. Some of 
these commands are explained below. 
15 a . BEGIN INPUT EXTENDED 

The Begin Input command starts an input period dj^^tta«r 
may press one or more buttons to select his or her choice®. The entry 
format of this command is set forth as follows: 

20 BEGIN INPUT UN} (VALID KEYS} {DIFFERENT} {FEEDBACK) 

N herC: The maximum number of keys that can be pressed. 
KEYS The valid keys that can be pressed. 
DIFFERENT Requires each key pressed to be different. 
25 FEEDBACK The feedback type provided to the V1 ewer. 

b. BEGIN VIDEO CHOICE EXTENDED 

The Begin Video Choice begins an input period for disco mode. During 
30 Sscc Xe, the video switches dynamically each time the v.ewer makes 
selection. 
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BEGlN_VIDEO_ CHOICE MODE (KEYS! {FEEDBACK (AUDIO]} 

The disco mode allows the viewer to change channels at will while the 
OneShot mode allows only one change of channel. 

MODE DISCO/ONESHOT 
KEYS The valid keys that can be pressed. 
FEEDBACK The feedback supplied to the user for the key(s) which are 
pressed. 

The mode Disco allows the viewer to change channels at will, while the 
OneShot mode allows only one change of channel. 

c. BEGIN AUDIO CHOICE EXTENDED 

The Begin Audio Choice begins an input period for disco mode. 

BEGIN_AUDIO_ CHOICE MODE [KEYS] {FEEDBACK [AUDIO]} 

DISCO/ONESHOT 
The valid keys that can be pressed. 
The feedback supplied to the user for the key(s) which are 
pressed. 



<L MAP 

The Map command is used to map video or audio tracks to keys, for use in 
connection with the Begin Audio Choice and Begin Video Choice 
commands. If this command is omitted, Key 1 will map to Track or 
Channel 1, Key 2 to Track or Channel 2 etc. This command allows 
mapping any key to any channel. 

MAP KEYS [TRACKS [T1„..TN/T1-TN] CHANNELS [C1,...CN/C1-CN]] 

The map statement maps audio tracks or video channels to keys, to enable 
audio or video choice commands to effect changes to tracks other than the 
default tracks, which are that key 1 maps to track 1, key 2 to track 2, etc.. All 
the choice statements after a map statement will cause the tracks, video 
tracks or channels to be changed to those specified in the map statement. 
The acceptable numbers for the map command are from 1 to 8, for keys, 
video channels and audio channels. 



MODE 
KEYS 

FEEDBACK 



Other commands include those which allow for the following applications: 
viewer profiling, to enable the set top box 25 to "remember" viewer 
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preferences; (2) uploading viewer responses to a central location; (3) downloading 
of text and graphics, for display using the graphics chip of the set top box 25; (4) 
the ability of the viewer to prepare his own video, based upon his selections of 
camera shots 100 and audio, which can be stored and replayed for the viewer. 
5 The interactive digital box 25 of the present invention enables seamless 

flicker-free transparent switching between the digital video signals. "Seamless" 
means that the switch from one video signal to another is user imperceptible. 
Because the video signals are running off the same dock, the interactive digital 
box 25 is capable of providing a seamless digital switch from one video signal to 
10 another signal. The program clock reference necessary for the box to make this 
. seamless switch is preferably embedded in the signal header. 

As shown in Figure 2, a CPU 260 is connected to an RF demodulator 200 
and digital demultiplexer 210. The CPU 260 directs demodulation and 
demultiplexing of the proper channel and data stream to obtain the correct video 
15 signal. Seamless switching can occur with MPEG-2 compressed signals since 
there are points within the frame wherein seamless switching can occur. 
Preferably, switches occur at an "I" frame, assuming the use of MPEG-2 
compression. The selected video signal is determined either by examination of 
the user's input from user interface 270 and/or any other information or criteria 
20 (such as personal profile information) stored in RAM/ ROM 265. For example, 
the RAM /ROM 265 could store commands provided within the video signals as 
discussed in U.S. patent no. 4,602,279, and incorporated herein by reference. 

The RF demodulator 200 demodulates data from the broadcast channel 
directed by the controller 260. After the data stream is demodulated, it passes 
25 through a forward error correction circuit 205 into a digital demultiplexer 210. 
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^ The demultiplexer 210 is controlled by the controller 260 to provide a specific 
video signal out of a number of video signals which may be located within the 
data stream on the demodulated broadcast channel. The demultiplexed video 
signal is then decompressed and decoded by decompressor/decoder 215. The 
5 video signal is synchronized by a sync add circuit 220 and a sync generator 225. 
The video signal is then buffered by a video frame buffer 230. The buffered video 
signal is modulated by a modulator 245 into a NTSC compatible signal. Such a 
modulator is not necessary if the selected signal is sent to a digital television 195. 
By using a video frame buffer 230 and delaying the viewing of a given 

10 signal, enough time is allowed for the decompressor/decoder 215 to lock onto, 
decompress, convert to analog, and wait for the resultant vertical interval of a 
second video signal. For example, assume video signal A is currently being 
processed and transferred through the circuit shown in Figure 2 and displayed. 
Based upon a user selection, the controller 260 directs the digital demultiplexer 

15 210 and RF demodulator 200 to switch to another video signal video signal B. To 
accomplish this, the analog video from the first digital video signal, video signal 
; A, complete with video sync, is fed into video frame buffer 230. This buffer 230 
can hold the full video picture for "n" number of frames after which the signal is 
output to the display. In effect, a delayed video signal A is viewed "n M number of 

20 frames after the signal has been received. When the user selects a different video 
path by means of pressing a button on a keypad or entry by other means, the 
controller 260 instructs the digital demultiplexer 210 to stop decoding signal A 
and lock onto signal B to begin decoding signal B instead of signal A. 

While this is happening, even though the decompressor/decoder 215 is no 

25 longer decompressing video signal A, the display is still showing video signal A 
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because it is being read from the buffer 230. As soon as decompressing and 
decoding occurs, the controller 260 looks for the next vertical blanking interval 
(VBI) and instructs the video frame buffer 230 to switch to its input, rather than 
its buffered output at the occurrence of the VBI. 
5 Since the RF demodulator 200, forward error corrector 205, digital 

demultiplexer 210, and decompressor/ decoder 215 require a certain time period to 
decompress and decode the video signal B frame from its data stream, the size of 
the buffer 230 has to be large enough so that this processing can take place 
without interruption during the switching of the video signals. If desired, the 
10 system may continue to use the buffer in anticipation of a future switch. By using 
the controller 260 to manipulate the fill and empty rate of the buffer 230, the 
buffer 230 may be rapidly filled with video signal B frames and then after a period 
of time will be reset and ready to make another switch to another video in the 
same manner. The buffer 230 may also be reset by skipping frames or providing a 
15 delay between sequential frame outputs for a short time in order to fill the buffer 
230. If a delay is used to maintain video signal or frame output while the buffer 
230 is being filled, a slight distortion may occur for a brief amount of time. 

Because a first video signal is always displayed as the output of the buffer 
230 after the delay, the buffered video masks the acquisition and decoding of a 
20 second video signal. As long as the buffer 230 is large enough to keep the first 
video running while the second video is being decompressed and decoded, a 
seamless switch will occur. 

While the digital interactive box 25 of Figure 2 provides video 
interactivity, audio and/or graphics interactivity is also provided. For example, 
25 if, based on the viewer profile or viewer response to query, it is determined that 
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the viewer's primary language is Spanish, then that viewer could obtain Spanish 
commentary to the football, soccer, etc. game. Alternatively, if a viewer has a 
favorite athlete, the audio can switch to an interview with the athlete during a 
segment of the broadcast- Multiple digital audio options forming a set of suitable 
5 responses to an interrogatory message can be sent as part of the composite digital 
signal. As set forth in U.S, patent no. 5,585,858, herein incorporated by reference, 
there are a number of different ways to effectively forward the necessary audio 
options for a given live event to the digital interactive box 25. With the present 
invention, it makes no difference how the audio options reach the digital 

10 interactive box 25, as long as they are available for selection and play at the 
appropriate times. 

In Figure 2, the digital demultiplexer 210 extracts the digital audio signal(s) 
and forwards them to the audio switch 250. Additional audio options are 
available from the digital audio memory 255. At certain times during the 

15 program, the data codes will identify the selection of a particular audio option 
corresponding to previous user inputs. The controller 260 calls the appropriate 
audio options from internal memory 255 or directs the audio switch 250 to select 
a predetermined audio segment received as part of the received digital signal for 
passage to the RF modulator 245 for play to the subscriber. At the end of the 

20 audio segment time period as indicated by the data codes, the controller 260 
instructs the audio switch 250 to again pick up standard audio. 

The digital demultiplexer 210 sends the extracted graphics data or ACTV 
data codes to the controller 260. The controller 260 interprets the extracted data as 
either control data, including instructions for switching between video signals, 
' 25 audio signals, or graphics data for on-screen display. If the data is on-screen 
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display data, the data is preferably prefixed by a command designating the data as 
on-screen display data, as opposed to control data. Further, the controller 260 also 
examines the control data for the occurrence of a header code designating the 
onset of a trigger point 500 in the program, explained below. 
5 Figure 3 shows an alternate, dual tuner embodiment for seamless 

switching between separate video signals. This embodiment presumes that two 6 
MHz channels are used, each of which comprises compressed digital video and 
audio streams. In this embodiment, the microprocessor 260 controls the selection 
of the RF channel that is demodulated By RF demodulators 200A, 200B. The 
10 demodulated data streams enter the forward error correctors 205A, 205B. At the 
output of the forward error correctors 205A, 205B the data streams are transmitted 
to the input of the digital demultiplexers 210A, 210B. 

As with the RF demodulators 200A, 200B, the digital demultiplexers 210A, 
210B are controlled by the microprocessor 260, This configuration allows the 
15 microprocessor 260 to independently select two different individual time- 
multiplexed video signals on different channels and data streams. If all the video 
.signals of an interactive program were contained on a single channel or data 
stream, it would only be necessary to have a single RF demodulator 200, forward 
error corrector 205, and digital demultiplexer 210 serially connected and feeding 
20 into the two digital video buffers 230A, 230B. 

Two data streams are provided from the digital demultiplexers 210A, 210B. 
One data stream carries video information pertaining to the video signal the user 
is currently viewing. The second data stream carries the video signal selected 
based on the user's previous and/or current interactive selections from the user 
25 interface 270, as determined by the microprocessor 260. 
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The digital information on each of the two streams is buffered in digital 
video buffers 230A, 230B. The buffered signals are then decompressed and 
converted into analog signals by decompressors/decoders 215A, 215B which 
include digital to analog converters. The decompressors 215A, 215B are preferably 
5 MPEG-2 decoders. 

A local sync generator 225 is connected to sync add 220A, 220B and frame 
sync 380A, 380B circuits. Because both streams are synchronized based on signals 
from the same local sync generator 225, each stream becomes synchroiuzed to the 
other. In particular, the signals on each stream are frame synchronized. 
10 A vertical blanking interval (VBI) switch 335 is connected to the 

' microprocessor 260 so that the input may be switched during the vertical 
blanking interval of the current stream, resulting in a seamless switch to the 
viewer. 

The embodiment of Figure 3 operates as follows. Based on user responses 
15 and control codes, it is assumed that the microprocessor 260 determines that a 
switch from video signal A to video signal C should be performed. The RF 
; demodulator 200A and digital demultiplexer 210A are processing the currently 
viewed video signal, video signal A, which is progressing through the upper 
branch components. A command is issued from the microprocessor 260 to the 
20 RF demodulator 200A, 200B commanding a switch to the channel and data 

stream on which video signal C is located. The microprocessor 260 also instructs 
the digital demultiplexer 210B to provide video signal C from the received data 
stream to digital video buffer 230B. 



At .his point, the upper RF demodulator 200A and digital demultiplexer 
210A are still independently receiving and processing video signal A. which 
continues through the upper branch of the circuit. 

At a certain point, the digital decompressor/decoder 215B in the lower 
branch will begin fitting up with video signal C frames. After video signal C is 
decompressed and decoded, it Is converted into analog. A local sync generator 225 
inserts both local sync and frame sync to video signal C via sync add drcuit HOB 
and frame sync circuit 380B in order to synchrony it with the currently 
delayed video signal A, which is s«U being provided from the upper digital 
video buffer 230A. At the appropriate switch point, triggered by programming 
codes supplied with each video signal A and C, the microprocessor 260 directs the 
VBI switch 335 to switch in me vertical Manhing interval from video A to video 
C at which rime video C will men seamlessly appear on the computer screen. 
Digital video buffets 230A 230B may be used in the drcuit of Figure 3. bu, 
U areoptional. However, in an alternative embodiment the buffers would be 
Kqul red to provide a seamless switch if the Hgure 3 drcuit was modified to 
incorporate a single BP demoduUtor 200. single forward error corrector 205. and 
single digital demultiplexer 2!0. each with , single input and single output, in 
flus alternative embodiment, the circuit cannot independently receive and 
20 demultiplex two data streams on different frequency channels. One buffer 230A 
„ used to store prevrously received video signal, while the other buffer 230B 
quickly passes through the selected video signals. 

Based on the same assumptions above, video signal A is progressing 
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C. However, in this alternative embodiment, the digital video buffer 230A is 
providing maximum buffering to video signal A. 

Because it is desired to switch to video signal C, the microprocessor 260 
directs the alternative circuit (containing a single RF receiver 200, single forward 
5 error corrector 205 and single digital demultiplexer 210 connected in serial), to 
receive and demultiplex the data stream on which video signal C is located, 
which may be different than that of video signal A. When video signal C is 
demultiplexed, the microprocessor 260 directs the digital video buffer 230 to 
provide minimum buffering of video signal C so that decompressor/decoder 215 
10 may quickly decompress and decode the digital signals. After decompression and 
decoding, video signal C is synchronized with video signal A. At this time, video 
signal A is read for display from digital video buffer 230A. The upper digital 
video buffer 230A must be large enough to provide video frames for output 
during the time it takes the RF demodulator 200 and digital demultiplexer 210 to 
15 switch to video signal C and the time required for decompression, decoding, and 
synchronization of video signal C. 

When video signal C is synchronized with video signal A, the 
microprocessor 260 directs VBI switch 335 to switch from video signal A to video 
signal C in the vertical blanking interval of video signal A, thereby providing a 
20 seamless and flicker-free switch. 

At this time, digital video buffer 230 will begin to utilize maximum 
buffering by altering its fill/empty rate .as described above with respect to the 
Figure 3 embodiment. When adequate buffering is achieved, a switch to another 
video signal may be performed in the same manner as described above. 



Another preferred embodiment is shown in Figure 4. This embodiment 
V also includes an RF demodulator 200, a forward error corrector 205, and a digital 
demultiplexer 210. However, the circuitry differs along the rest of the chain to 
the television set or monitor. In this embodiment, a memory 475 is incorporated 
5 and connected to the output of the demultiplexer for storing the compressed 
composite digital video signal. The decompressor/decoder 215 is inserted at the 
output of the compressed memory. The decompressor/decoder 215 decompresses 
the digital signal, converts the signal to analog and forwards the analog signal to 
the RF encode 245 for transmission to the monitor. Once the composite 
10 compressed digital video signal is fed into the compressed memory 475, the 
microprocessor 260 directs a pointer to be placed somewhere along the 
compressed digital video signal. Based on the placement of the pointer, different 
frames and different segments of the composite digital video signal will be read 
from memory 475 for decompression and decoding. 
15 The different video signals are distinguished from one another because 

they are labeled, preferably by headers. Assuming that video signal A has been 
. selected for play on the monitor, the compressed digital memory 475 fills up with 
A frames. Assuming a switch to video signal C Ift desired, the microprocessor 260 
directs the RF demodulator 200 and digital demultiplexer 210 to begin filling the 
20 compressed memory 475 with video C frame, The decoder 215 pointer begins to 
move down. As soon as a sufficient number of C frames have entered the 
compressed memory 475, the pointer will then jump to the beginning of the C 
frames. The C frames are then output into the decompressor/decoder 215 where 
the digital frames are converted into an analog signal. 
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The digital video is multiplexed in a series of easily identifiable packets. 
These packets may contain full compressed frames of video (I frames) or may 
include only the differences between full frames (B frames or P frames). 

To be able to reconstruct the full video images, the decompressor/decoder 
5 215 needs to have a minimum number of I, P and B frames. The decoder 215 
needs only one I frame to decode an image. Conversely, two prior Anchor frames 
(TV and T*s") are necessity to decode B frames. In order to decode P frames, the 
decoder 215 only needs one Prior Anchor frame. When the microprocessor 
instructs the digital demultiplexer 210 to start sending packets from a different 
10 data stream there is no way to be certain that the next packet will be an I packet 
needed for decoding the second video stream. To avoid a breakup of the video 
images, which would occur if the decompressor/decoder 215 suddenly started 
receiving packets unrelated to the stream it was decoding, the microprocessor 260 
starts to fiU up the memory 475 with video signal C packets until it is determined 
19 tat » full sequence of I, B and P frames are available. The decoder 215 should 
receive me last bi. of the last B frame in , given. GOP (Group of Pictures) before 
the switch, in order to prevent glitches when decoding. Furthermore, .he las. B 
frame of (he GOP mus. only be backward predicted, no. forward predicted or 
bidirectional predicted. As soon as .he valid sequence is in memory 475 me 
20 microprocessor 260 moves .he memory read pointer to the star, of a valid 
sequence of C video signal packets so that .he decompressor/ decoder 215 can 
successfully decode the C signais. This results in a seamless switch from video 

signal A to video signal C. 

This embodiment requires a da.a channel for enabling a synchronous 
25 switch becween a firs, video s.ream and a second video stream. This da,a channel 
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toow when .hey ^ * ^ . responding user 

^^^^oran,^^^^^^^ 
15 active events should correspo^ ^ ^ ^ ^ „ prog[am 
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audio segments. 500 , the present invention 
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■ oreferences. For example, if ft. P^am broadest is a live'spofts 
(Kc viewers preferences. 

eve,. !0, a. an early .rigger poin. 500, .he viewer could be quened 

j o in Endish, Spanish. French, or perhaps 
a. viewer would prefer «, recetve audro * EngUsh. p 
he „ fte .oca, announcer instead of tire netwo* announcer. Upon the vrew r 
lection, the CPU 260 direefs a branch ,o the appropriafe in.era.ve ^ 

""Til. 

M include a.arnin ta u»,.hefoUowingin f o n na n on: (1) header 

10 M irirLra^corhabifbasedonviewerprofUe. 

0I particular vrewer (ha , a Bitter point 500 is about to 

sequence simply Identifies .o fte confer that mgge P 
1 ^efuncdonmdesisna.esften.acroorofterse.of — 
occur, me run i nttrm et to obtain the desired 

tawed* for the controller 260 to read and tnterpre . 

„ elected video and/or audio response. 
B result, e.g., a selec ^ ^ decoder , ^ controller 260 reads 

. '-Tiir^— ^ — — 

"Tb B l:C P o, 5 .c 0 de,.euserse,ec.ionscorre S pond ra 

^ ^ fa series o, fct.erroga.ory messages preferably presented a. fte 
subscriber answers to - _ ^ „ 

20 ^ftg of *e program. After exe cutable instructions using the user 
con.ro„er 260 reads and performs the e«c ^ 

a ur^d video stream, audio and / or 
either a selected via pres t 0 red, called 

, Hio response can be called from memory 26o if it is p 
vid eo/audio respo _ d ^ 

25 from external data storage, or the cont 
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„. some identifier corresponding to a a e ^ ^ ^ 
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memory 265, preferably RAM, and used later as reared by an algorithm 
designated at a trigger point 500. 

E. Internet 

to addition «o the centra! studio serving as a source of interacHve option 
tesponS es, the Interne, can he used as a source of personal information for 

interactive responses. 

A, discussed above, the video programming is preferably created a. a 
^traUzed location, U., the control studio S as shown in Figure 1, for 
„ motion to subscribers in their ho.es. Referring to Figures 1 and 6, in a 

jarred m«hod, the operator a, the contro, shidio 5 must designate certam Web 
pageslo correspond ,o one of the progranr options, such as audio and/or graphics 
op^usingcontrolPClBSandml-encodereOO. Ins*ad of encodmg the 

„ address idendfiers, U. Uniform Resource Locators (URLs, are encoded and sent 
^artofdtedatacodesfromthecontrolPClSS^edigi.l.ultiplexerm 

' ^ muUiplexing, *e URLs are sent as par, of the program signs, 615. as 
described above. Preferabiy, the URLs, Uhe the various audio and graphics 
options, have associated time stamps which indicate to the remote digita, set top 
20 bo , es2 Swben,durmgmevideoprogram,od i sp 1 a y meparbcu,arWebpages 
addressedb.theURU.heseiecdonanddispi.ofwhich.preferabiymadeasa 

function of viewer responses or viewer profile. 

. a' -h.1 too box 25 has an Internet connection 160 create 
Preferablv, each digital set top box ^ 

.•„_ The Internet connection 160 can be via 
concurrently with the cable connection. The Intern 

, j.m The digital set top box 25 has Internet 
25 high-speed line. W. conventional modem. The dig. 
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. current ASCU software mechanisms, in a preferred 
KCKS 160 via any of ft. curren demulti plexer 210 

embo ai,ent, in the in.erac.ive - -P - * 

wfW areforperfornun g partof* b ^ brow5 eraUow 3l h« 

. Ai<Ato\ set top box 25. The Java e» 
on the interactive drgrtal set .op prefe rred 

u«v n to retrieve the Web pages «u» r 
^cuvedigitalsettopboxBtorem ^ ^ 

., „ tat fomi independent, and thus, enames 
10 transfer of programs, .mages, e ., and ^ Fernet functions of Ore 

v ia«5 at the appropriate times. 
15 ^vision monr.or 165 a. ^ ^ ^ , 

fa *. presen. invenhon. the re« ^ ^ ^ 

pro duc t described in an advertent by ^ ^ ^ 

,.20 the producer's Website could be accessed y 
remote 20, P ^ ^ obtain more 

20 and displayed «o the viewer. The 

■ ho ut the product or order the product, if destre 
irrformatton about the p asso dated with the 

Upon selection by the viewe, 
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seized software .hen synches the We b pages for video disp.ay. 



, The mteracdve dig*. - -P - - - *° — " * * 

v w* linking video/audio streams and/or 

software algorithm) and memory 265 to store p 

these previous responses in the algorithm to conrro! future 
15 l0 process these ptev, ii as future graphics message selection, 

ideo/audio stream selection, as well as furore g P 
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u j^^*—- - can have a 

of ^ Me a£— . st some centra, .ocafto, 

cable headend. If me pr , f 

lhey can also he sen. to each viewer s home O ^ ^ 

fnr ^oraee and dissemination t>y way 
25 central location for storage a 
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Onions regarding personal — g and v^g can then be.made for a 
" viewer or class of viewers based on the accumulated parameters. 

The "viewer profile" preferably contains characteristics of the particular 

5 pro ae is created by having me viewer respond to a series of questions. 

Thisinformadonisthenusedby thecabiebo, 

soft ware to create a compendium of me viewer's interesis and preferences - ,e.. a 
^ proffle. The stored user profile would be used in place of the 

10 ^on/answer forma, and fhus, dictate the branches to interactive segment of 

' interest to the viewer. 

Mternatively, me interact cabie box 25 can be programmed to creaie 
^pmHle of each viewerbased on the selecfions made during — *e 

rams If the profile shows ma. a particular viewer does not en,oy 
interactive programs, umepron .,.»,„ 
» violence, the system can automatically branch to another video stgnal a, 

—cementofafightinaspo.program. Purmermore.su chauserpm. 
. rould b e modified or eruiched over time based on selections mad, dum, «. 

be ^ to modify the user profile based on user response over time. 
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. Evenl da „ is eo„e«ed .rom me viewer - — . ' 

VIEWER PROFILE 
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events whicn are r duljng a, e 

SedtS^ewer selections. 



„ roffl e is cxeated, me program*** choices or inactive 
Once the profile » ct pot 
v. Peered based on the content of the v,ewerp 
^canbetrtgg ^ viwet „ «— » 

15 example, if *« viewer profile sugge at , 

rt« or commercial could be played tor m 

— OTS ' a TZ - *. — — i£ a viewer ' 5 p 

" rier «~ would trigger the active program to 

. such a program, the * . ^ ^ ^ . send the re apes 

20 download recipes and either o P , 

,o an attached printer. ^ be „Uec.ed a. the control studio 5 

, fcncaons. ^J^^^**,.***-** 
send bach data on command 
| com mand W initia.eanuploado f vie«erpro,tleda,a 

*. • ' V ■ 
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UPLOAD EXTENDED 
d is used .c ini «a,e U-e up. M d ta s o. a.» to *e «n«aU iK . 

UPWADjDENTinER ^variable to bounded 

VARIABLE NAME - Stag, that consists ol numbers 

10 needed. 



. , ic scheme is used, the statistics and 
otto user profile inionnation. prefer sen 
use of me back-channel 

H . ^^..nowtorseveralpossibleappUcaHons. 

- — - " ^ ^ could tbe standard video 
- -mp, m a live , ^ - _ ^ „ ^ close . 

a.aonel, «i* other channe, arrv S ^ ^ ^ ^ 

^particular players. Ofherpo^al ? 

statistical informatxon on the play 
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^e provision o, trigger points SCO. ^d on 

seamless integration of such video options during 



"?*z - *~ wtoh » • — - ■ 

Fo r example, the v.ewe ^ ^ ^ a fM 

t \t ¥\>a viewer can direct wwuw / 
5 bt oad=as.ofgolf.«hev.ew , tatWs 

™ hnle-to-hole, focus on one particularly on 

different tunes, ines When the 

. cplection was made, ate stored m memory Zbo 

"Cracon^-s-nve^^nao.^ 

^-emenUng games ^ ^ ^ ^ 

^ple.snaphicsove.Uyscenbedeve^p ^ with ^ 

20 in.enogatonesas.hefoUow.ng: 

What will be the next play? (RUN/PASS/KICK). 
Wffl the offense get the firs, down?; 

Will they score on this possession?; 
Pick the half time score; 
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Who will win? 
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i back to the control studio 5 for 
Each viewer's responses can be sent bade 

„,»nackaeed at the digital cable box 
Nation of scores. Preferably, the responses are packaged 9 

* and «— - - control studio 5 via th. digitai backchanne, upon 

UPLOAD EXTENDED — d. Native,, .buiation o< scor« can take 

r^eivethegi,^— *« — ' 

""l, Ore viewer has the option * - — ^ - 

i if rt«> viewer is adverse to violence 
viewing of certain events. For example. >f the vrewer 

„ m the svstem can block out such 
« during a spornng event or other deprogram, the svs 

EVENT 

breaking out during a football game). 

20 EVENT EVENT^NUMBER 

EVENT—NUMBER is a numeric constant. 

ON EVENT EXECUTE MACRO 
«. command is used to implement certain actions fsuch as an auto^ 

example), as soon as the even, artives. 
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ON_EVBNT EVENT J«MBER MACRO JIUMBER 
EVENT_NUMBER is a numeric constant. 
M ACRO_NUMBER is a numeric constant. 



vrdeostgna* ^signals are thea sen*, to a cental 

compressed at the control studio 5. The stgn 

» switch^ station, or headend 30. 

h this embodiment, the switching between the vanous g> 

iished at the headend 30 rather than a, the recetver. On the rec 
is accomplished at the located 

. 7fin re i avs viewer selections Dac*. 

each digital set-top box 760 relays ^ 

« *n Preferably, the viewer selections are relayed y 
switching sta.cn 30, Prefe ^ ^ selections may be relayed to the 

15 digit albac kC hannel770.Howeve,thev I ewer 

f ,. rtn 3 n by any conventional means, such as two y 
switching station 30 by any 30 

.i W«ne or microwave transmission. The sw 
revision, teiephone ^ ^ ^ 750 

receives the viewer se,echon and ro.es 

which conventionally transmits the destred 

A,*, central switching statum 30. P A[mmbero f 

, d Places each on a separate bus channel ,35. A num 

compressed signals and places ^ ^ ^ ^ 
remotecontrol^ractiveswitchesm^^V 

. „. Rased on the viewer selections, an algonttun 
si8 nal bus 735. Based ^ ^ , digltal 

25 265 and under processor 360 control a. the cen 
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> h is made and .he se.ec.ed video, audio and/or graphics are 
seamless switch is made an 
Warded to the viewer home for display. 

Such a two-way embodiment cou,d be indented . d. 

_ In such a system, only » single video channel 755 » 
video server system. In sucn , 

„ Once the viewer selection to received at the server 

„«cessarv for each home. Once tne vie 

rlheadendSO.aswUchtomadetotheappropria.evideostreamanddus . 
♦ «n the single channel 755 to the home. 

, h .line Whence viewer enters a selection on *e.r remote 

^phonehnesothatasing . ^ ftom the headend 30 

a Hh, receiver and the transmission of that choic 
^de at the receiver „ SMnS e to *e interactive selection . 

where the actual switching takes place in response 

15 made at the receiver. and switching station 30 may be 

i. i u^ftx/PPn the viewer ana swncim*B 
The two-way bnK between* Mc „ y be transferred from 

^ fot other purpose, ? or exampie, demograpn ma 

* e viewer to commercial purposes, 

erasing, billing, or other commit a « n ^ ^ ^ 

, While me present— ^ ^ otential f or enhancing 

- — - * ^ SP "I b orne their own director of a 
content in other program categories. A ^ 

„ mvS .erv or other drama. By entering responses to displaye , 
^ " or during ,e show, the program will branch ,0 ahemative 
lhe nation of or dun _ ^ ^ _ ^ 

25 video/audio segments as a res 
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viewers wHh different sevens may end up with a different murderer a, the 
conclusion of the broadcast. 

may be made within the scope of the accompanying claims. 

A receivers receiving five programming containing a 
copending application No. 23430 9 5 from which the present case 
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CLAIMS 



,. A system for providing ft. intake programming, comprising; 
means receiving audio signals; 

TO ans for produoing oorresponding audio signals; 
aneastonedigitaioompreasiondevicafordigMlycomprassingthe 

video and audio signals; 

audio signals into a oombined dig.tal program 

for transmitting the oombined digital program stream. 

1 , wherein said video signals are obtatned from ££f « 
one or more of the cameras relaying a parent , ew of 
wherein the audio signals correspond to the hve event 

, or Cairn 2. further comprising meamfor £WW by said 

s signals, wherein said graphica ^stgna s araj *» «£ W " program 
digital compression device and mulhplexed ,nto serf 
stream by said digital multiplexer. 

4 ^m^^P^^^""^ 
30 means is a satellite transmission system. 

Q Hmn rlaim wherein the transmission 

5 A system as claimed in any preceding cla.m. wn 
means is a cable distribution system. 

Q Hinn Haim wherein the transmission 
35 6 A system as claimed in any preceding .claim, wn 
means is a broadcast transmission system. 
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- 7. A system as claimed in any preceding claim, wherein the combined 
digital program stream is received within a private network. 

8. A system as claimed in any preceding claim, wherein the combined 
5 digital program stream is received within an in-stadium network. 

9. A system as claimed in any preceding claim, wherein the combined 
digital program stream is received over the Internet. 

io 10. A method for providing live interactive digital programming, comprising 
the steps of: 

obtaining a plurality of video signals; 

15 producing one or more corresponding audio signals; 

digitally compressing the video and audio signals; 

digitally multiplexing the digitally compressed video and audio signals 
20 into a combined digital program stream; and 

transmitting the combined digital program stream. 

1 1 A method as claimed in Claim 10, wherein the plurality of video signals 
25 are obtained from a plurality of video cameras, at least one of the cameras 

relaying a view of a live event. 

12 Amethod as claimed in Claim 10 or Claim 1 1 . further comprising the 
step of delaying at least one of the video signals for a predetermined amount of 

30 time to create a replay video signal. 

13 A method as claimed in any of Claims 10 to 12. wherein the combined 
digital program stream is transmitted over a satellite transmission system. 

35 14 A method as claimed in any of Claims 10 to 12, wherein the combined 
digital program stream is transmitted over a cable distribution system. 
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